Papers with open-response question answering systems
The price of debiasing automatic metrics in natural language evalaution (P18-1)
Copied to clipboard
| Challenge: | Existing methods to evaluate natural language systems are expensive and expensive. |
| Approach: | They propose to combine automatic metrics with human judgment to obtain an unbiased estimator at lower cost than human evaluation alone. |
| Outcome: | The proposed estimator reduces the cost of evaluating summarization and open-response questions by 7-13%. |